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(54) Superim position in a video display system 

(67) A signal is generated for producing a video display of superimposed images, one of which is derived 
from a system for detection of non-visual signals, such as an ultrasonic inspection system 12,13 whilst the 
other is a television image produced by video camera 16. Accurate registration of the superimposed 
images is achieved by providing a movable probe 13 of the ultrasonic inspection system indicating the 
location of inspection with a point source 15 of light or other radiation to which the video camera responds. 
During each raster scan of the video camera the position of the point source is registered and data, 
representing the response of the detector system, stored In a memory system. An output from the 
memory system is combined 22 with the camera video signal to produce the superimposed images. When 
the probe indicates that test piece 1 1 is O.K, only switch 24 is closed giving a green image, but at points 
where the test piece is defective only switch 23 is closed giving a red image (as opposed to a black and 
white image for untested area). 
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SPECIFICATION 

Superimpoeltlon in a video display system 

6 The invention relates to apparatus for provid- 
ing a video display in which an image derived 
from one or more detector systems Is super- 

I imposed upon a visual image derived from a 

'camera. 

10 In this way a user of the apparatus can be 
assisted by relating the output of a non-visual 
signal detector device to the visual appearance 
of the Image produced by the camera of an 
object under test. 

15 Whilst highly sophisticated image processing 
and handling techniques are available using 
computers or microprocessors, a problem with 
the type of image superimposltion referred to 
above Is that of registering one Image in Its 

20 proper relationship and scale with the other. 
One solution to this problem is disclosed in 
GB 2 136 242 according to which apparatus 
is provided for generating a video display sig- 
nal capable of driving a suitable imaging sys- 

25 tern to produce superimposed Images from 
two or more detector systems, which appara- 
tus comprises a camera, one or more detector 
systems, the or at least one of the detector 
systems including a movable probe, a source 

30 on the probe, the position of which source is 
indicative of the position of investigation of 
the associated detector system, and which 
source produces light, or other radiation to 
which the camera responds, in excess of a 

35 predetermined intensity whenever the detected 
6ignal of the said associated detector system 
has a predetermined characteristic, the camera 
producing, when trained upon an area includ- 
ing the said position of investigation, a video 

40 signal including that produced by the light or 
other radiation from the said source on the 
probe, a threshold detector for detecting 
whenever light or said other radiation received 
by the camera exceeds the said predetermined 

45 intensity, a memory system scanned in syn- 
chronism with the video signal from the cam- 
era and arranged to store the video signal at 
all positions where the said predetermined in- 
tensity is exceeded, and means for mixing vi- 

50 deo signals from the memory system with the 
video signals from the camera so that the 
mixed signals when fed to an imaging system 
are displayed as the visual image seen by the 
camera with superimposed bright points at all 

55 positions on the image where the said predet- 
ermined intensity has been exceeded. 

The present invention is a development of 
that described in GB 2 136 242 and provides 
apparatus for generating a video display signal 

60 capable of driving a suitable imaging system 
to produce superimposed images, which appa- 
ratus comprises a video camera, one or more 
detector systems, the one or at least one of 
the detector systems including a movable 

65 probe, a source on the probe, the position of 


which source is indicative of a position of in- 
vestigation of the associated detector system, 
and which source produces light, or other ra- 
diation to which the camera responds, having 
70 a distinguishing characteristic, the camera pro- 
ducing, when trained upon an area including 
the said position of investigation, a video im- 
age signal including that produced by the light 
or other radiation from the said source on the 
75 probe, a memory system, means for scanning 
of the memory system In synchronism with 
the video image signal, means responsive to 
the said distinguishing characteristic for pro- 
viding Identification of the address In the 
80 memory system of the position of the probe, 
means operative independently of the said dis- 
tinguishing characteristic under control of the 
detector system for causing the memory sys- 
tem to store at the said Identified address a 
85 representation of detector system output at 
the position of the probe corresponding with 
the said identified address, and means for 
combining video image signals from the cam- 
era with video signal elements derived from 
90 the memory system so that the combined sig- 
nals when fed to an imaging system are dis- 
played as the visual image seen by the cam- 
era with superimposed picture elements repre- 
sentative of detector system output at post- 
95 tions of investigation of the probe. 

The said means under control of the detec- 
tor system may trigger the memory system 
whenever output from the detector system 
has a predetermined characteristic to store at 

100 the said identified address in the memory sys- 
tem corresponding with the position of the 
probe data representing a predetermined video 
signal element, so that the said combined sig- 
nals when fed to an imaging system are dis- 

105 played as the visual image seen by the cam- 
era with superimposed predetermined picture 
elements at all positions of investigation of 
the probe at which the detector system has 
produced output having the said predeter- 

110 mined characteristic. 

In this way, using a camera which responds 
to visible light and a light source on the 
probe, it is possible to scan the probe over 
an object and build up an array of bright 

1 1 5 points superimposed upon the ordinary visual 
image of the object, the bright points corre- 
sponding with some predetermined character- 
istic under investigation. Thus for example, the 
detector system may be as described in Brit- 

120 ish Patent Specification No 2044198 In which 
backscattered penetrating radiation is de- 
tected, for example neutrons to reveal low 
atomic number material concealed behind 
steel. 

1 25 There may be additional detector systems 
each including a probe with a light source 
thereon. In this case it is desirable to distin- 
guish one detector system from another by 
using different coloured light sources on the 

130 probes. Further, the indication of the response 
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of a single detector system may be sub-div- 
ided by providing on the probe a plurality of 
light sources distinguishable from one another 
by differences. In colour, It is also possible for 
5 certain applications that display may be 
wanted of only the images produced by 
scanning the probes of two or more detectors 
without including display of the visual scene. 
In this case the camera would be set to re- 

10 spond only to the brightness of the light 
sources on the probes and to produce no Im- 
age from other sources of light. 

In one arrangement according to the Inven- 
tion the said distinguishing characteristic is 

15 provided by an intensity of the light, or said 
other radiation, In excess of a predetermined 
intensity. In this case, the said means respon- 
sive to the distinguishing characterstic includes 
a threshold detector. It will be appreciated 
- 20 that, to avoid false Indications of probe posi- 
tion, the intensity of the light, or said other 
radiation, from the source has to exceed that 
from any other object within the scene ob- 
served by the camera. 

25 In another arrangement according to the in- 
vention the said distingishing characteristic is 
provided in that the light, or said other radia- 
tion, from the source is flashing or modulated 
in a predetermined manner, and the said 

30 means responsive to the distinguishing charac- 
teristic responds to the said flashing or modu- 
lation. 

Conveniently, the said predetermined video 
signal element has one characteristic, for 
35 example for a green coloration, when the out- 
put from the detector system has one charac- 
teristic, for example indicative of no defect, 
and the said predetermined video signal ele- 
ment has another characteristic, for example 

40 for a red coloration, when the output from the 
{ detector system has another characteristic, for 
example indicative of the presence of a de- 
fect. Where a detector system is capable of 
providing a range of output signals indicative 

45 of a corresponding range in the property to 
which the. detector system responds, then a 
corresponding range of characteristics, for 
example in the form of a grey scale, of said 
predetermined video signal element may be 

50 generated. 

Preferably the memory system and the said 
•means for scanning of the memory system 
compromise a microcomputer. Synchronism 
with the video camera is achieved by connect- 

£5 ; ing a synchronising signal output from the mi- 
crocomputer to a synchronising signal input on 
the camera, so as to drive the camera scan in 
synchronism with the video display signal gen- 
erator of the microcomputer. 

60 A specific construction of apparatus embo- 
dying the invention wifl now be described by 
way of example and with reference to the 
drawing filed herewith, which is a block circuit 
diagram of the apparatus. 

65 The drawing shows a system for superim- 


posing on an Image of a visual scene an Im- 
age produced using a detector of non-visual 
signals, In this example an ultrasonic Inspec- 
tion system. 

70 A sample under inspection Is represented at 
11 . A conventional ultrasonic Inspection sys- 
tem 12 has a probe 13 and provides an out- 
put signal on line 14. In a simple arrangement, 
this output signal is digital having one level (1) 
76 when the system detects a defect within the 
region of inspection and another level (0) 
when no defect is detected. 

The probe 13 is modified for the purpose of 
the present example by mounting thereon a 
80 point source of light 15 which is switched 
permanently on for the duration of a test. 

A monochrome video camera 16 is provided 
with synchronising signals on line 1 7 from a 
microcomputer 18. The output signal from the 
85 camera 1 6 representing the intensity of each 
pixel in the raster scan sequence is fed via 
line 19 to a threshold detector 21 and to a 
network 22 by which the monochrome inten- 
sity signal is applied via solid state switches 
90 23, 24, 25 to three lines 26, 27, 28 con- 
nected respectively to the RGB (red, green, 
blue) inputs of colour monitor 31, As will be- 
come clearer from the following description, 
the synchronising signal from line 17 together 
96 with RGB on lines 26, 27, 28 all connected to 
the colour monitor 31 provide a composite 
colour video Image signal input in a standard 
format to the colour monitor 31. 
The solid state switches 23, 24, 25 are 
100 controlled respectively by the RGB output 
from the microcomputer, shown as lines 32, 
33, 34. The associated switch 23, is closed 
when the line 32, carries a signal and open 
when the signal is at a predetermined low 
105 level. Switches 24, 25 operate in the same 
way from the signal levels on lines 33 and 34 
respectively. 

A television to X-Y converter 35 is provided 
for generating X,Y coordinates representing 
110 position for the microcomputer memory sys- 
tem from the television raster scan signal. A 
synchronising signal for the converter 35 is 
provided on line 1 7 and output signals on line 
36 to the microcomputer 1 8 combined with 
115 those on line 14 from the ultrasonic inspection 
system provide data input to the microcompu- 
ter 18. Operation of the converter 35 is under 
control of the threshold detector 21. 
In operation, the intensity of light from the 
120 source 15 is set at a leve| exceeding that 
from any other object in the field of view of 
the camera 16. 

Initially, all the solid state switches 23, 24, 
25 are closed so that the monitor 31 displays 
125 a black and white picture corresponding with 
the visual scene observed by the camera 16. 
However, as the camera scan takes in the 
image of the point source 15, the light inten- 
sity is such that the signal level on line 19 
130 exceeds the threshold set in threshold detec- 
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tor 21. This triggers converter 35 to supply 
to the microcomputer 18 on line 36 the ad* 
dress of the computer memory location corre- 
sponding to the position in the image at that 
6 instant of the point source 15. 

In this example, the microcomputer 18 is 
programmed to store at that address data 
from line 14 in such a form that output sig- 
nals on the RGB lines 32, 33, 34 from the 
10 microcomputer will have the following effect 
at all subsequent scans until the data at that 
memory address Is changed or reset; 

1. If there is no defect signal on line 14, 
switches 23 and 25 are opened, switch 24 is 

15 closed 

2. if there is a defect signal on line 14, 
switches 24 and 25 are opened, switch 23 is 
closed. 

The consequence is that the piwel(s) in the 
20 display corresponding to the position of the 
point source 14 is (are) turned green if there 
is no defect signal and red if there is a defect 
signal. If the probe 13 is now moved to 
make, for example, a scanned inspection of 
25 the sample 11, each new position is ''painted 
in" on the display, green showing where in- 
spection has been carried out and no defect 
found, red showing where defects have been 
found. 

30 In this example the computer is programmed 
so that if the probe 13 is scanned over a 
region more than once, green display can be 
changed to red, but not vice versa. Thus, de- 
tection of a defect shows as red on the dis- 

35 play even although a previous scan of the 
same area revealed no defect. However, once 
a defect has been detected, the associated 
red display cannot be changed back to green. 
It will be appreciated that the arrangement 

40 as described will operate with any form of 
detector system having a binary or on/off out- 
put signal characteristic. 

However, the flexibility of a microcomputer 
is readily harnessed to give a more sophisti- 

45 cated capability. Thus a detector system giv- 
ing a range of six different output signal char- 
acteristics is readily accommodated in the ar- 
rangement described by switching to generate 
green, red, blue, red/green, red/blue, green/- 

50 blue according to which detector signal char- 
acteristic is received. 

For example the ultrasonic inspection sys- 
tem 12 has a facility for providing an Indica- 
tion of whether or not the coupling between 

55 the probe 13 and the sample 11 is satisfac- 
tory. A signal indicating poor coupling can 
thus be arranged to produce a particular col- 
our as a warning to the operator showing re- 
gions of the sample where the scan should be 

60 repeated. 

For stiir greater sophistication in which a lar- 
ger number of detector output signal charac- 
teristics is. accommodated, then it is neces- 
sary to introduce, rather than simple switch- 

65 ing, a mixing of signal intensity from the com- 


puter RGB output with that from the video 
camera. 

One problem met on occasion with the 
apparatus of this example Is that the threshold 
70 level in the threshold detector 21 is exceeded 
by the appearance of a bright object, uncon- 
nected with the probe 13, in the field of view 
of the camera 16. A solution is to provide 
periodic automatic detection of the maximum 
75 intensity in the Image when the point source 
15 is switched off and to reset the intensity 
of the point source 15, on switching it on 
again, to a level in excess of that maximum. 
The threshold detector 21 has, of course, to 
80 be reset simultaneously to a level above that 
maximum and below the new level of the po- 
int source 16. 

Another solution Is provided by a modifica- 
tion in which the point source 15 is made to 
85 flash on and off in synchronism with each 
successive frame scan. The threshold detector 
21 Is omitted and the microcomputer 18 is 
programmed to register pixels which switch 
on and off in phase with the frame scan. 
90 The invention is not restricted to the details 
of the foregoing example. Other detector sys- 
tems can be used such as, for example, use 
penetrating radiation or eddy currents. Indeed, 
the apparatus can be used with any detector 
95 system for which response can be confined to 
limited areas defined by a probe position or 
probe and associated point source position. 

It may be convenient, as described in G6 2 
136 242 to use one or more lenses and/or 

100 mirrors to provide a desired apparent or vir- 
tual position of the point source. 

The arrangement is readily adapted for use 
with a camera which responds to other than 
visual radiation. Thus, a camera sensitive to 

105 infra-red radiation, for example may be used. 
Where the camera, as is usual, also responds 
to visible light, an infra-red emitting diode 
could be used as the source on the probe. 
The intensity of the infra-red emitted by the 

1 10 diode would have to be such as to exceed a 
predetermined reference level. Alternatively, an 
infra-red camera would clearly enable a general 
image to be formed of a scene (eg at night) 
which is not illuminated with visible light but 

115 which is emitting infra-red. In that case the 
source on the probe could also be an infra-red 
emitting diode or alternatively could be a 
source of visible light. 
The composite video signal output may be 

120 recorded on a video recorder for subsequent 
display via a monitor. The composite video 
signal may be transmitted over long distances 
by cable or radio transmission if desired. 
In a development, initial setting up of the 

125 camera iris and intensity of the source on the 
probe is made easier by additional camera sig- 
nal output level detectors and software con- 
trol. Thus, for example, under software con- 
trolled instructions displayed on the screen, 

130 the operator is required to adjust the camera 
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irla, with the probe source off, until the maxi- 
mum Image signal Intensity (the brightest ob- 
ject in the visual scene) Is greater that 50% 
and less than 7096 of the maximum (satura- 
5 tion) output of which the camera is capable. 70 
The probe source is then switched on and its 
intensity increased stepwise until it produces 
an. output signal intensity at 95% of the cam- 
era maximum. 

10 75 
CLAIMS 

1 . An apparatus for generating a video dis- 
play signal capable of driving a suitable imag- 
ing system to produce superimposed images, 

15 which apparatus comprises a video camera, 80 
one or more detector systems, the one or at 
least one of the detector systems including a 
movable probe, a source on the probe, the 
position of which source is indicative of a po- 

20 sition of investigation of the associated detec- 85 
tor system, and which source produces light, 
or other radiation to which the camera re- 
sponds, having a distinguishing characteristic, 
the camera producing, when trained upon an 

25 area including the said position of fnvestlga- 90 
tion, a video image signal including that pro- 
duced by the light or other radiation from the 
said source on the probe, a memory system, 
means for scanning of the memory system in 

30 synchronism with the video image signal, 95 
means responsive to the said distinguishing 
characteristic for providing identification of the 
address in the memory system of the position 
of the probe, means operative independently 

35 of the said distinguishing characteristic under 100 
control of the detector system for causing the 
memory system to store at the said identified 
address a representation of detector system 
output at the position of the probe corre- 

40 sponding with the said identified address, and 105 
means for combining video image signals from 
the camera with video signal elements derived 
from the memory system so that the com- 
bined signals when fed to an imaging system 

45 are displayed as the visual image seen by the 
camera with superimposed picture elements 
representative of detector system output at 
positions of investigation of the probe. 
2. An apparatus as claimed in claim 1, 

50 wherein the said means under control of the 
detector system trigger the memory system 
whenever output from the detector system 
has a predetermined characteristic to store at 
the said identified address in the memory sys- 

55 tern corresponding with the position of the 
probe data representing a predetermined video 
signal element, so that the said combined sig- 
nals when fed to an imaging system are dis- 
played as the visual image seen by the cam- 
60 era with superimposed predetermined picture 
elements at all positions of investigation of 
the probe at which the detector system has 
produced output having the said predeter- 
mined characteristic. 
65 3. An apparatus as claimed in claim 1 or 


claim 2, wherein the said distinguishing char- 
acteristic Is provided by an intensity of the 
light, or said other radiation, in excess of a 
predetermined intensity and the said means 
responsive to the distinguishing characteristic 
includes a threshold detector. 

4. An apparatus as claimed in claim 1 or 
claim 2 r wherein the said distinguislng charac- 
teristic is provided in that the light, or said 
other radiation, from the source is flashing or 
modulated in a predetermined manner, and the 
said means responsive to the distinguishing 
characteristic responds to the said flashing or 
modulation. 

6. An apparatus as claimed In claim 2, 
wherein the said predetermined video signal 
element has one characteristic, when the out- 
put from the detector system has one charac- 
teristic, and the said predetermined video sig- 
nal element has another characteristic, when 
the output from the detector system has 
another characteristic. 

6.. An apparatus as claimed In claim 2, 
wherein a detector system is capable of pro- 
viding a range of output signals Indicative of a 
corresponding range In the property to which 
the detector system responds, and a corre- 
sponding range of characteristics of said pre- 
determined video signal element is generated. 

7. An apparatus as claimed In any of the 
preceding claims, wherein the memory system 
and the said means for scanning of the mem- 
ory system comprise a microcomputer and 
synchronism with the video camera is 
achieved by connecting a synchronising signal 
output from the microcomputer to a synchron- 
ising signal input on the camera, so as to 
drive the camera scan in synchronism with the 
video display signal generator of the micro- 
computer. 

8. An apparatus substantially as hereinbe- 
fore described with reference to, and illus- 
trated in, the drawing filed herewith. 
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